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Multibeam  Data  Evaluation  for  DOLPHIN 
and  Ship  Collection  Platforms 

1.0  Introduction 

Ocean  mapping  has  traditionally  been  performed  by  survey  launches  or  ships 
with  hull-mounted  transducers.  These  vessels  are  subject  to  severe  heave, 
roll,  and  pitch,  which  then  introduce  depth  measurement  errors.  For  offshore 
surveys  a  ship  with  its  inherent  high  operational  cost  must  be  used  in  place  of 
the  small  survey  launch.  By  traveling  a  lew  meters  beneath  the  surface  of  the 
ocean,  a  Remotely  Operated  Vehicle  (ROV)  is  relatively  immune  to  the  action 
of  the  waves  and  should  therefore  provide  higher  accuracy  data  at  a  smaller 
cost.  As  part  of  the  Canadian  Ocean  Mapping  System  (COMS)  project,  it  has 
been  shown  that  using  the  Deep  Ocean  Logging  Platform  with  Hydrographic 
Instrumentation  and  Navigation  (DOLPHIN)  ROV  with  an  EMIOO  system 
provides  a  cost-effective  mapping  platform  for  coastal  and  offshore  areais  [1]. 
Productivity  may  be  further  increased  by  using  two  DOLPHINs  alongside 
a  mother  ship  with  its  own  echo  sounder  in  a  configuration  such  as  the  one 
shown  in  Fig.  IL  The  vessel  acts  as  the  mother  ship  for  both  ROVs  and 
uses  the  Global  Positioning  System  (GPS)  for  positioning.  Large  areais  can 
be  surveyed  in  shorter  periods  of  time.  Furthermore,  Preston  stated  in  [3] 
that  in  rough  seas  DOLPHIN  could  operate  while  neither  a  small  nor  a  large 
ship  could. 

Many  Navy  efforts  have  focused  on  developing  efficient  hydrographic  data 
collection  platforms,  as  well  as  increasing  the  number  of  miles  surveyed  per 
survey  ship.  As  part  of  these  efforts,  the  Naval  Research  Laboratory  (NRL) 
and  the  National  Oceanic  and  Atmospheric  Administration  (NOAA)  con¬ 
ducted  a  joint  test  and  evaluation  of  the  DOLPHIN/EMIOO  system.  The 
DOLPHIN  tests  were  conducted  over  the  period  of  29  July  1992  through  8 
August  1992  with  a  DOLPHIN  owned  by  the  Canadian  Hydrographic  Ser¬ 
vice  (CHS)  and  operated  by  Geo-Resources,  Inc.  (GRI)  of  Newfoundland, 
Canada.  The  survey  lines  were  run  from  5  August  1992  through  7  August 
1992.  The  DOLPHIN  was  remotely  operated  from  NOAA’s  ship  Whiting 
using  a  Ultra  High  Frequency  (UHF)  radio  link. 

'Reproduced  from  [2] 


I 


Fig.  1:  Survey  configuration  with  two  DOLPHINs 


The  data  collected  consisted  of  along-  and  across-track  lines  in  a  pre¬ 
selected  site  over  the  Norfolk  Canyon,  as  well  as  transit  data  with  shallow 
and  intermediate  depth  waters.  Patch  tests  were  also  run  for  pitch,  gyro, 
time  delay,  and  roll.  The  surveys  were  conducted  with  the  DOLPHIN  sev¬ 
eral  hundred  meters  directly  ahead  of  NOAA’s  ship  Whiting.  The  Whiting, 
equipped  with  a  Hydrochart  II  (HC  II)  sonar,  collected  data  over  the  same 
lines  so  that  two  data  sets  obtained  with  very  similar  conditions  are  avail¬ 
able  for  comparison.  Unfortunately,  the  DOLPHIN  data  were  collected  by  a 
SIMRAD  EMIOOO  transducer  with  EMIOO  electronics,  a  different  multibeam 
sonar.  The  USNS  Littlehales  ran  the  same  lines  during  the  week  of  23  August 
1992,  giving  a  third  data  set  for  evaluation.  The  Littlehales  also  collected 
data  with  an  EMIOO  multibeam  sonar. 

Preston’s  evaluations  [3]  showed  that  DOLPHIN’s  pitch  was  smaller  and 
at  a  lower  frequency  than  that  of  the  ships  that  ran  the  same  survey,  and 


he  concluded  that  DOLPHIN  is  more  stable  in  pitch  than  a  500-ton  ship. 
dolphin’s  heave  in  quartering  seas  was  considerable  and  similar  to  that 
of  the  ships.  He  also  showed  that  when  the  ROV  is  towing  a  fish,  it  excites 
its  towed  downweight  more  than  a  ship,  with  quite  a  high  frequency  of  the 
downweight  depth.  Some  of  the  results  presented  in  this  report  somewhat 
disagree  with  his  conclu.^ions. 

This  report  is  organized  as  follows.  We  first  present  brief  descriptions 
of  the  DOLPHIN  and  the  multibeam  sonars  used  during  the  tests,  followed 
in  Section  3  by  a  description  of  the  surveys  and  the  tests  performed.  Sec¬ 
tion  4  presents  the  methods  used  to  evaluate  the  DOLPHIN,  while  Section 
5  presents  the  results.  Attitude  movement  of  the  platform,  frequency  of 
dropouts,  and  beam  and  system  noise  were  analyzed,  and  the  bathymetry 
produced  by  the  data  collected  by  the  three  systems  were  compared.  A 
companion  report  [4]  presents  details  on  DOLPHIN’S  performance,  logistics, 
operation,  and  manpower  requirements. 


2.0  System  Descriptions 

Brief  descriptions  of  the  DOLPHIN  and  the  sonar  systems  used  for  the 
tests  conducted  for  DOLPHIN’S  evaluation  are  given  in  this  section.  The 
echo  sounders  are  SIMRAD’s  EMIOO  and  General  Instrument  Corporation’s 
(GIC’s)  HC  II. 

2.1  The  DOLPHIN 

The  DOLPHIN  is  a  torpedo-shaped  snorkeling  semisubmersible  ROV  that 
weighs  3.3  tons  and  measures  7.6  m  in  length  and  approximately  1  m  in 
diameter.  It  usually  travels  about  3  m  below  the  surface  of  the  sea.  It  can 
travel  at  speeds  up  to  14  kt  up  to  6  km  away  in  Line  Of  Sight  (LOS)  from 
the  mother  ship.  The  DOLPHIN’s  5  m  mast  is  used  for  air  intake  to  the 
diesel  engine  and  for  the  UHF  radio  and  GPS  navigation  antennae.  Details 
about  dolphin’s  design  and  operation  are  given  in  [1]  and  [4]. 

2.2  The  SIMRAD  EMIOO 

The  EMIOO  is  a  multibeam  echo  sounder  that  operates  at  95  kHz,  with  a 
maximum  of  32  receiving  beams  and  3  possible  athwartship  beam  apertures. 


3 


I 

I 

I 


Table  1:  Beamforming  modes  of  the  EM  100 


Mode 

Swath  width 
degrees 

No.  beams 

Beam  width 
degrees 

Coverage 
times  water  depth 

Ultrawide 

100 

27 

2.4 

Wide 

32 

1.7 

Narrow 

32 

mBBii 

0.7 

The  aiongship  beam  aperture  is  fixed  at  3”.  The  beamforming  modes  of  the 
EMIOO  are  shown  in  Table  1,  The  maximum  coverage  is  100®,  corresponding 
to  2.4  times  the  water  depth  using  the  ultrawide  mode.  The  beam  fan  is 
electronically  stabili2ed  in  roll  and  mechanically  in  pitch.  The  transducer 
may  also  be  mounted  without  pitch  stabilization.  For  transmission  each 
transducer  element  is  connected  to  separate  power  amplifiers.  The  transducer 
array  consists  of  96  individual  elements  80  cm  wide  and  a  curvature  of  45  cm. 
The  elements  have  common  transmission/reception  functions.  Designed  to 
be  mounted  on  a  retractable  hull  unit,  the  EMIOO  was  specifically  developed 
for  continental  shelf  and  coastal  water  survey  tasks.  The  hull  unit  allows 
the  transducer  to  be  lowered  to  a  position  approximately  1  m  below  the  hull 
during  a  survey  to  avoid  air  bubbles.  The  DOLPHIN  does  not  have  the 
retractable  hull  unit. 

The  EMIOO  has  an  operating  range  between  10  and  600  m  of  depth. 
SIMRAD  claims  accuracies  better  than  0.5%  of  the  water  depth  across  the 
entire  swath  [5].  The  collected  data  are  stored  in  digital  form  in  depth, 
position,  and  miscellaneous  datagrams.  It  can  acquire  up  to  about  3  Mbyte  of 
bathymetric  data  per  hour  and  more  in  shallow  water  [2].  A  heave/roll/pitch 
sensor  with  good  accuracy  must  be  connected  to  the  multibeam  echo  sounder. 
Depth  data  will  then  be  corrected  for  ship  motion.  Tide  compensation  is 
performed  in  the  postprocessing  phase. 


2.3  The  Hydrochart  II 

GIS’s  HC  II  is  a  dual  transducer  multibeam  sonar  system  that  operates  at  36 
kHz.  The  system  uses  a  cross-fan  transducer  array  to  produce  9  beams  for 
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port  and  9  for  starboard,  with  overlapping  near- nadir  beams.  The  system 
switches  between  the  two  sets  of  nine  beams  each  ping  cycle.  The  swath 
coverage  of  the  HC  II  is  2.5  times  the  water  depth  or  105°. 

A  Differential  Global  Positioning  System  (DGPS)  was  used  aa  the  primary 
navigation  system  for  the  survey.  Two  differential  receivers  were  used  to 
monitor  the  differential  correctors  and  compute  geographic  positions. 

3.0  Area  Surveyed 


The  area  surveyed  consisted  of  the  preselected  Site  B  in  the  Norfolk  Canyon 
and  transit  data  from  and  to  the  station.  The  center  of  Site  B  was  located 
62  nmi  east  of  Cape  Charles,  Virginia,  at  Norfolk  Canyon.  The  surveyed 
areas  are  shown  in  Fig.  2.  The  survey  lines,  run  by  DOLPHIN  in  Site  B, 
are  shown  in  Fig.  3,  where  lines  B03  through  BOS  are  the  lines  parallel  to 
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the  contours  and  shown  left  to  right,  and  lines  B21,  B22,  the  pitch  test  lines, 
and  B24  are  perpendicular  to  these,  and  shown  from  top  to  bottom  of  the 
figure.  Site  B  was  approximately  2400  m  (1.3  nmi)  by  5500  m  (3  nmi). 


DOLPHIN  Main  and  Cross  Linas  in  Sits  B 


Fig.  3:  Survey  lines  of  Site  B 

The  project  consisted  of  several  tests  designed  to  provide  data  for  the 
evaluation  of  DOI.PHIN’s  performance.  The  tests  were  as  follows: 

Patch  Test:  Whiting  held  station  while  DOLPHIN  conducted  a  patch  test. 
The  patch  test  consisted  of  six  lines,  two  perpendicular  to  the  contours 
to  evaluate  pitch  errors,  and  two  sets  of  reciprocal  lines  perpendicular 
to  each  other  to  evaluate  roll  errors. 

Accuracy  Test:  It  consisted  of  six  main  lines  (B03-B08)  run  parallel  to 
the  contours  in  Norfolk  Canyon.  Line  spacing  was  selected  to  overlap 
for  comparison  of  EM  100  outer  beams  of  one  line  with  the  inner  beams 
of  the  next  line.  Three  up-down  slope  crosslines  (B21,  B22,  B24)  were 
run  perpendicular  to  the  main-scheme  lines. 
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Sea  State  Test:  Line  BOS,  run  during  the  accuracy  test  with  calm  seas, 
was  repeated  with  a  rougher  sea  state  of  light  chop  and  3-ft  swells  (line 
BOSa).  The  intent  of  this  test  Weis  to  evaluate  the  effects  of  sea  state 
on  the  acquired  data. 

Feature  Presentation:  Survey  lines  were  planned  to  run  perpendicular 
to  the  contours  of  a  very  steep  feature  in  the  Norfolk  Canyon.  The 
intent  was  to  see  if  there  was  any  time  lag  in  the  data  logging  by  com¬ 
paring  contours  acquired  running  upslope  with  those  acquired  running 
downslope.  When  the  lines  were  run,  the  depicted  feature  was  not 
found. 

Heave  Test:  Two  sets  of  reciprocal  lines  (HTla,  HTlb,  HT2a,  HT2b)  were 
run  perpendicular  to  each  other  in  a  shallow  flat  area.  The  intent  was 
to  get  data  that  could  be  used  to  evaluate  heave  effects  on  the  platform. 

Transit  Data:  Whiting  and  DOLPHIN  collected  simultaneous  data  while 
transiting  to  and  from  the  survey  area.  This  long  line  provides  addi¬ 
tional  data  for  comparisons. 

Sea  conditions  on  the  first  day  of  the  survey  (5  August  1992)  were  calm, 
with  no  wind  waves  and  no  swell.  On  the  following  two  days  there  w£is  a 
light  chop  with  3-ft  swells. 


4.0  Testr  •'.nd  Evaluation  Methods 


This  section  describes  the  different  tests  and  processing  applied  to  the  col¬ 
lected  data  sets.  The  purpose  is  to  evaluate  the  performance  of  the  DOL- 
THIN  ROV  as  compared  to  ship-codection  platforms,  and  in  particular,  the 
resulting  bathymetry. 

To  fairly  compare  one  system  to  another,  all  environmental  variables  such 
as  ship’s  speed  and  sea  state  should  be  the  same  for  all  tests  and  constant 
for  the  duration  of  the  test.  When  this  was  not  possible  (such  as  compar¬ 
ison  to  Litilehales  data  collected  on  a  different  date),  we  tried  to  minimize 
the  effects  or  make  comparisons  that  are  robust  with  respect  to  changes  in 
these  conditions.  For  example,  when  computing  the  system  dependent  noise 
analysis  we  compared  data  from  the  Littlehales  to  data  from  the  DOLPHIN, 
while  comparison  of  pitch  data  (which  is  sea  state  and  platform  dependent) 
was  performed  between  the  Whiting  and  the  DOLPHIN.  Bathymetry  com¬ 
parisons  were  performed  between  the  three  possible  pairs  of  platforms. 

4.1  Attitude  Movement  Tests 

The  contributions  to  depth  error  come  from  the  lack  of  knowledge  of  ray 
bending,  roll  angle,  pitch  angle,  and  heave.  All  of  the  above  plus  yaw  produce 
position  errors.  Both  depth  and  position  are  degraded  with  roll  errors,  but 
only  position  is  affected  appreciably  for  the  inner  beams,  and  only  position 
is  significantly  affected  by  pitch  [6].  The  contribution  of  yaw  to  the  error  in 
depth  is  negligible  except  when  the  slope  of  the  bottom  is  steep.  An  error  in 
heave  contributes  to  errors  both  in  depth  and  beam  position.  Since  heave, 
roll,  and  pitch  all  affect  either  positioning  or  depth  calculations,  or  both,  it 
is  important  to  determine  DOLPHIN’S  movement  during  a  survey  and  how 
it  compares  to  the  ship  platform. 

We  analyzed  the  amplitude  of  heave,  roll,  and  pitch  vs.  time,  as  well 
as  their  power  spectra  which  yield  information  about  their  frequency  re¬ 
sponse.  The  beam  data  of  the  echo  sounders  is  not  sampled  uniformly, 
so  interpolation  to  obtain  evenly  spaced  amplitude  vs.  time  is  performed 
prior  to  computing  the  power  spectra  with  fast  Fourier  transform  (FFT) 
routines.  Low-pass  interpolation  is  performed  using  a  symmetric  filter  that 
allows  the  original  data  to  pass  through  unchanged  and  interpolates  between 
data  points.  Statistics  of  the  attitude  data,  such  as  mean  and  variance,  are 


computed  and  their  distribution  is  also  estimated.  Unfortunately  the  data 
files  from  \Vhitingl]AC  II  that  we  were  able  to  read  (merged  .SBO  files)  do 
not  contain  the  needed  attitude  data;  these  merged  files  only  contain  pitch 
information. 

4.2  Dropouts 

We  define  dropout  as  depth  samples  that  are  set  to  zero  by  the  system  as 
a  result  of  an  error  check  or  due  to  the  impossibility  of  obtaining  a  depth 
measurement  for  the  corresponding  sample  time.  The  number  of  dropouts 
gives  an  idea  of  the  robustness  of  the  combination  of  system  and  platform. 
We  compare  the  number  of  dropouts  of  the  DOLPHIN  data  to  the  number  of 
dropouts  of  data  from  the  Littlehales,  the  two  platforms  carrying  the  EM  100 
echo  sounder. 

4.3  Beam  and  System  Noise 

In  order  to  investigate  how  noisy  the  different  systems  are,  and  how  noisy 
the  various  beams  of  each  system  are,  we  performed  fits  to  the  depth  vs. 
time  data  for  each  beam,  subtracted  the  fitted  data  from  the  collected  data, 
and  assumed  the  residue  to  be  noise.  The  procedure  is  shown  graphically  in 
Fig.  4,  where  DOLPHIN  data  from  the  center  beam  of  line  BOS  were  used. 
All  dropouts  are  discarded  before  data  fitting  and  computation  of  noise  since 
they  will  significantly  affect  the  outcome. 

The  following  filtering  technique  is  used  to  obtain  a  smooth  fit  to  the 
raw  data:  Decimation  is  first  implemented  by  low-pass  filtering  the  raw  de¬ 
meaned  data  with  an  eighth  order  Chebyshev  filter  and  then  resampling  at 
a  lower  rate.  Low-pass  interpolation  is  then  applied  to  the  resampled  data 
to  obtain  the  smooth  curve  that  fits  the  original  data.  This  interpolation 
is  implemented  by  passing  the  decimated  data  through  a  symmetric  digital 
filter  that  minimizes  mean  square  error.  The  mean  is  then  added  back  in 
after  interpolation.  A  spline  fitting  method  yields  almost  identical  results. 

In  order  to  obtain  valid  conclusions  when  comparing  noise  in  the  different 
beams  of  a  single  system,  the  analysis  is  done  using  data  from  flat  areas, 
such  that  ail  beams  are  steered  to  regions  of  similar  depths.  Noise  levels 
are  not  only  dependent  on  the  beam  number  and  system  but  also  on  the 
operating  depth;  this  is  clear  in  Fig.  4  where  we  see  the  noise  level  increasing 
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Raw  Data  and  Smooth  Fit 
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Fig.  4;  Noise  analysis  procedure 

with  increcising  depth.  On  the  other  hand,  when  we  compare  noise  between 
systems,  we  use  larger  sets  of  data  that  include  different  morphology. 

In  [7]  the  author  gives  precision  in  terms  Root  Mean  Squared  White  Noise 
(RMSWN).  The  method  described  there  yields  the  system’s  noise  provided 
that  the  spectrum  flattens  out  in  the  last  10%,  and  this  10%  represents  the 
system’s  noise.  The  spectra  of  the  depth  signals  we  analyzed  in  this  report 
do  not  flatten  out  nicely  so  this  method  was  not  used. 

4.4  Comparison  of  Bathymetry 

Bathymetry  is  produced  by  postprocessing  the  multibeam  data  collected  dur¬ 
ing  a  survey,  although  near-real-time  bathymetry  is  certainly  possible.  The 
bathymetry  is  a  triplet  (Lat, Lon, Depth)  that  describes  the  topography  of 
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the  surveyed  area.  Both  the  EMIOO  on  the  DOLPHIN  and  the  HC  II  on 
the  Whiting  recorded  position  as  latitude  and  longitude,  while  the  EMIOO 
on  the  Littlehales  used  UTM  coordinates.  All  three  systems  recorded  depth 
in  meters.  After  merging  depth  with  position,  the  HC  II  “merged  files”  con¬ 
tain  depth  quantized  to  1  m;  the  EMIOO  depth  datagrams  register  depth 
quantized  to  0.075  m. 

Even  if  the  systems  were  perfect  and  independent  of  environmental  vari¬ 
ables  such  as  weather  and  sea  state,  and  the  processing  algorithms  were  the 
same  for  all  systems,  we  would  not  expect  the  triplets  to  be  identical  regard¬ 
less  of  the  systems  used  to  collect  the  data.  Not  only  is  the  original  point 
bathymetry  different,  but  also  further  differences  are  introduced  with  the 
gridding  routines  used  [8].  Here  we  compare  bathymetry  produced  by  the 
three  platforms,  as  well  as  bathymetry  collected  by  the  same  platform  — 
the  DOLPHIN  —  on  different  dates. 

Standard  bathymetry  processing  yields  data  that  are  unevenly  spaced. 
Before  comparing  bathymetry  we  grid  the  position  to  a  common  evenly 
spaced  lat/lon  grid.  The  grid  is  often  determined  by  the  average  distance 
between  closest  neighbors  in  the  unevenly  spaced  data  with  the  coarsest  grid. 
Other  times  the  gridded  interval  is  determined  by  other  factors,  such  as  scale 
of  the  desired  map  or  processing  time  required.  Once  the  data  sets  are  all  in 
a  common  grid,  the  difference  between  them,  AZ,  is  analyzed  by  computing 
the  mean  difference  between  platforms,  fi,  the  sample  standard  deviation  of 
the  difference,  <t,  and  the  rms  difference,  where  these  quantities  are  defined  in 
the  usual  way,  and  given  in  (l)-(4),  respectively,  for  continuity.  Notice  that 
cr  and  rms  are  identical  if  the  data  have  zero  mean  or  if  they  are  demeaned 
for  processing,  and  they  are  therefore  frequently  used  interchangeably. 
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It  must  be  noted  that  the  comparisons  and  the  statistics  and  conclu¬ 
sions  obtained  from  them  are  dependent  on  the  gridding  (interpolation  and 
extrapolation)  routines  used  (8).  We  tried  to  avoid  extrapolations  by  only 
comparing  areas  common  to  all  data  sets  used;  this  unfortunately,  means 
that  we  have  to  work  with  numerous  very  small  areas  instead  of  a  single 
larger  area. 

The  standards  of  the  International  Hydrographic  Organization  (IHO)  (9j 
for  depth  soundings  require  that  with  a  probability  of  at  least  90%,  the  total 
error  should  not  exceed  0.3  m  at  depths  between  0  and  30  m,  and  1%  of  the 
depth  for  depths  greater  than  30  m. 

4.5  Repeatability  Test 

The  repeatability  analysis  is  also  a  comparison  of  bathymetry,  but  between 
results  generated  from  data  sets  collected  by  the  same  platform  —  in  this 
case,  the  DOLPHIN  —  at  different  times,  and  with  similar  conditions.  These 
results  are  not  expected  to  match  perfectly  but  are  expected  to  closely  agree. 
The  procedure  used  is  the  same  as  that  described  in  the  previous  section. 
When  data  for  a  given  line  are  collected  with  different  sea  states,  comparing 
bathymetry  produced  by  the  two  surveys  could  give  an  indication  on  how 
these  conditions  affect  the  platform. 


5.0  Results 


Results  of  the  data  analysis  performed  to  evaluate  the  DOLPHIN  as  a  multi¬ 
beam  sonar  data  collection  platform  using  the  methods  just  discussed  are 
given  in  this  section.  We  begin  by  presenting  some  results  about  the  atti¬ 
tude  data. 

5.1  Analysis  of  Attitude  Test  Data 

Pitch  vs.  time  for  WHITING'S  Line  BOS 


Fig.  5:  Pitch  vs.  time  (line  BOS) 

We  analyzed  pitch  data  from  the  WhitingfUQ  II  and  pitch,  heave,  and  roll 
data  from  the  DOLPHIN/EMIOO.  Pitch,  heave,  and  roll  are  also  available 
for  the  Littlehales,  but  since  this  ship  surveyed  the  area  on  a  different  date, 
comparisons  to  the  DOLPHIN  were  not  made. 

Figure  5  shows  filtered  pitch  vs.  time  for  both  the  Whiting  and  the  DOL¬ 
PHIN  for  line  BOS,  one  of  the  main  lines  in  Site  B.  The  plot  shows  smoothed 
(low-pass  filtered)  data  to  try  to  eliminate  the  visual  quantization  effects  that 
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are  different  for  the  two  systems  and,  more  importantly,  to  minimize  differ¬ 
ences  due  to  the  much  lower  sampling  rate  of  the  HC  II.  The  actual  pitch 
recorded  by  the  HC  II  is  quantized  to  0.1®,  while  the  EMIOO  quantizes  pitch^ 
to  0.2°.  Figure  5  shows  that  DOLPHIN’S  pitch  for  line  BOS  is  considerably 
smaller  than  that  of  the  Whiting;  analysis  of  a  large  set  of  data  indicates 
this  is  not  typically  the  case,  which  disagrees  with  Preston’s  conclusions  [3]. 
We  suggest  that  the  direction  of  the  ship’s  motion  and  the  way  in  which  the 
waves  hit  the  vessels  {e.g.,  quartering  vs.  head  seas)  have  a  large  influence 
on  the  platform’s  pitch. 


Platform 

Line 

DOLPHIN 

Whiting 

B03 

DOLPHIN 

Whiting 

B04 

DOLPHIN 

Whiting 

BOS 

DOLPHIN 

Whiting 

B06 

DOLPHIN 

Whiting 

B07 

DOLPHIN 

Whiting 

BOS 

DOLPHIN 

Whiting 

B21 

DOLPHIN 

Whiting 

B24 

max 

variation 


1.3 

2.1 


2.1 

1.4 


1.9 

2.6 


2.2 

1.6 


1.2 

2.1 


2.6 

1.2 


2.1 

1.6 


1.2 

1.7 


Table  2  shows  some  statistics  for  the  pitch  data  from  DOLPHIN  and 
Whiting  for  several  lines  in  Site  B.  Clearly,  we  cannot  conclude  that  the 

^Documentation  [5]  states  that  pitch  is  quantized  to  0.1’’. 


ROV  pitches  less  than  the  ship.  The  results  for  this  particular  survey  of  Site 
B  consistently  indicate  that  the  DOLPHIN  pitched  less  with  one  direction 
seas,  but  has  a  larger  pitch  amplitude  with  opposite  seas.  Also  notice  that 
when  the  pitch  amplitude  of  the  DOLPHIN  is  larger  it  is  so  by  a  small 
amount  most  of  the  time,  while  the  difference  is  much  larger  when  its  pitch 
is  smaller  that  the  Whiting's.  The  standard  deviations  of  the  pitch  of  both 
platforms  are  very  dependent  on  the  direction  of  travel  and  so  is  the  maximum 
variation.  Also  clear  in  Table  2  is  that  both  platforms  had  a  pitch  bias,  the 
dolphin’s  bias  being  smaller,  about  0.6®  bow  down^.  DOLPHIN  is  pitched 
down  slightly  on  purpose  to  avoid  surfacing. 


Pitch  tor  WHIUNG's  Une  BOS 


Fig.  6:  Pitch  vs.  time  (line  BOS) 

In  Fig.  6  we  plotted  the  variation  in  pitch  about  the  mean  for  a  section 
of  line  BOS  for  both  Whiting  and  DOLPHIN.  In  both  cases  the  data  were 
interpolated  to  a  common  sampling  rate,  and  therefore,  smoothed.  Notice 

^Patch  tests  were  conducted  to  determine  biases.  Although  patch  test  data  have  not 
yet  been  analyzed,  we  expect  results  to  agree  with  those  given  here. 
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Pitch  (deg) 


that  the  ship’s  pitch  for  line  BOS  has  spurts  of  large  amplitude.  We  found 
these  spurts  to  be  characteristic  of  most  of  the  pitch  data  from  the  Whiting, 
and  also  from  the  Litihkales,  although  this  behavior  is  not  constantly  present. 
For  example,  the  spurts  on  line  BOS  cease  after  about  250  s  and  are  therefore 
not  seen  in  Fig.  5.  Nothing  like  it  appears  on  the  pitch  data  from  the 
DOLPHIN.  Figure  7  shows  this  behavior  for  the  Littiehales. 


UTTLEHALES’s  Pitch 

— I - 1 - 1 — 


Sample  Number 


Fig.  7:  Pitch  vs.  sample  number  for  Littiehales 

Figure  8  shows  the  power  spectrum  of  pitch  for  both  the  DOLPHIN  and 
the  Whiting  for  line  B03.  In  this  figure  the  frequency  axis  is  given  as  nor¬ 
malized  frequency  where  1.0  corresponds  to  half  the  sampling  rate,  or  0.5  Hz 
at  the  sampling  frequency  of  /,  =  1.0  Hz.  We  see  that  DOLPHIN’S  spec¬ 
trum  is  quite  flat  for  all  frequencies  (i.e.,  white),  while  Whiting's  decays  more 
rapidly.  This  confirms  what  we  see  in  Fig.  5  and  especially  in  Fig.  6,  that  is 
the  random-like  behavior  of  the  pitch  of  the  DOLPHIN.  Also,  DOLPHIN’S 
pitch  peaks  at  a  lower  frequency  than  Whiting's,  which  agrees  with  results 
presented  in  [3]. 

Figure  9  shows  some  results  of  the  analysis  of  heave  data  from  DOLPHIN 
for  a  section  of  line  C.  The  top  plot  shows  the  depths  of  the  center  of  the 
EM  100;  the  middle  plot  shows  the  heave  registered,  and  the  bottom  figure 
shows  the  noise  present  in  the  center  beam.  It  was  thought  that  noise  was 
mainly  due  to  heave  effects,  and  we  therefore  investigated  the  correlation 
between  the  two.  We  found  no  evidence  that  the  noise  is  highly  correlated 
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Normalized  frequency  (fs°1Nz) 

Fig.  8:  Power  spectral  density  of  pitch  {line  B03) 

to  the  heave,  although  we  see  that  the  amplitude  of  the  heave  is  very  similar 
to  that  of  the  noise.  Analysis  of  DOLPHIN  data  from  the  heave  test  area 
indicates  the  power  spectrum  of  DOLPHIN’S  roll  peaks  around  0.085  Hz,  or 
a  period  of  approximately  12  s.  The  distribution  of  the  roll  is  very  close  to 
normal,  with  a  roll  bias  of  about  1.25”  to  starboard.  The  pitch  bi2is  of  the 
DOLPHIN  in  this  area  is  about  0.7”  and  doesn’t  change  much  with  time  and 
change  in  course.  The  major  frequency  component  of  pitch  for  this  area  is 
around  0.089  Hz,  although  another  very  strong  component  appears  at  a  little 
less  than  half  this  frequency.  The  rms  value  of  DOLPHIN’S  heave,  pitch,  and 
roll  in  this  area  are  approximately  0.2  m,  0.3”,  and  0.9”,  respectively. 

dolphin’s  transit  data,  i.e.,  line  C,  indicates  that  the  frequency  of  roll 
is  higher  than  that  of  pitch  with  the  largest  component  with  a  period  of 
about  7  s.  The  spectrum  of  roll  does  not  change  much  until  about  0.3  Hz. 
The  rms  roll  is  about  0.6®,  while  the  rms  pitch  is  about  0.3®.  The  probability 
density  function  (pdf)  of  roll  looks  Gaussian,  but  the  distribution  of  pitch 
seems  more  like  a  Laplacian  pdf.  The  histograms  of  heave  data  for  line  C 
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Fig.  9:  Depth,  heave,  and  noise 

also  show  a  Laplacian-like  pdf  for  DOLPHIN’S  heave,  with  a  mode  of  zero 
and  quite  symmetric  around  its  mean.  The  heave  signal  has  a  very  strong 
sinusoidal  component.  Heave  and  roll  are  not  available  from  the  HC  II  merge 
files  from  the  Whiting. 


5.2  Dropouts 

The  number  of  dropouts  for  the  Littlehales /EMIOO  was  extremely  large  for 
ail  the  data  sets  studied,  while  the  corresponding  number  of  dropouts  for 
the  DOLPHIN/EMlOO  was  quite  low,  even  for  the  outer  beams.  Table  3 
lists  the  number  of  dropouts  for  the  two  platforms  for  a  few  of  the  survey 
lines.  In  this  Table  id  means  intermediate  depth  (around  500  m)  and  sh 
means  shallow  (around  50  m).  There  are  32  beams  for  the  EMIOO,  we  chose 
to  analyze  only  the  center  beam,  beam  16,  and  an  off-nadir  beam,  beam 
number  5.  Notice  the  DOLPHIN  suffered  very  few  dropouts,  even  when 
sampling  at  rates  comparable  to  the  Littlehales's;  it  is  reasonable  to  expect 
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more  dropouts  at  a  higher  sampling  rate,  that  is  why  the  average  dropout  rate 
(ADR)  is  listed  in  Table  3.  The  center  beams  of  the  ship  usually  suffered  from 
considerably  less  dropouts  than  the  off-nadir  beams,  while  this  was  always 
the  czise  for  the  ROV.  It  is  not  clear  why  the  Littlekales's  center  beam  had 
more  dropouts  than  its  beam  number  5  on  line  603.  This  didn’t  happen 
to  the  DOLPHIN,  and  the  depths  are  such  that  frequent  dropouts  are  not 
expected. 


Table  3:  Comparison  of  dropouts 


Platform 

Line^ 

6eam 

No. 

DOLPHIN 

Littlehales 

606 

16 

DOLPHIN 

Littlehales 

606 

5 

DOLPHIN 

Littlehales 

621-22 

16 

DOLPHIN 

Littlehales 

621-22 

5 

DOLPHIN 

Littlehales 

C 

(steep) 

16 

DOLPHIN 

Littlehales 

5 

DOLPHIN 

Littlehales 

assM 

16 

DOLPHIN 

Littlehales 

5 

DOLPHIN 

Littlehales 

603  (id) 
(flat) 

16 

DOLPHIN 

Littlehales 

603  (id) 
(flat) 

5 

No.  of  No.  of 
Samples  Drops 


Sample 
Rate  (Hz) 


I  sh:  shallow;  id:  intermediate  depth.  |  Average  Dropout  Rate 
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The  number  of  dropouts,  both  absolute  and  as  percentage  of  total  sam¬ 
ples,  and  the  ADR  were  much  better  for  the  DOLPHIN  than  for  the  ship,  so 
there  is  more  useful  data  for  it  than  for  the  ship.  This  is  important  since  not 
only  can  the  DOLPHIN  operate  in  adverse  weather  conditions  when  surface 
vessels  cannot  [3],  but  also  a  larger  percentage  of  the  data  gathered  by  its 
EMIOO  in  the  same  conditions  is  good. 

Figure  10  shows  the  center  beam  depths  vs.  time  recorded  for  the  cross 
line  B22  of  the  Littlehales  and  the  DOLPHIN.  Remember  that  conditions 
such  as  sampling  rate,  ship  speed,  and  sampling  duration  are  not  identical, 
and  therefore,  at  a  given  sampling  time  the  two  systems  will  be  sampling 
two  different  points  on  the  bottom;  this  explains  the  slight  differences  in  the 
profiles  shown.  Since  we  were  interested  in  studying  and  showing  dropouts 
in  the  raw  data,  the  depths  shown  in  Fig.  10  were  neither  georeferenced  nor 
corrected. 


Center  Beam  Depths  and  Dropouts  for  LITTLEHALES’s  Une  B22 


Fig.  10:  Center  beam  data  of  line  B22 

Figure  11  shows  plots  of  DOLPHIN  and  Littlehales  data  before  and  after 
removal  of  dropouts  for  a  different  line.  These  points  could  have  been  inter- 
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polated,  but  instead  we  simply  discard  the  bad  samples.  Littlehales  clearly 
has  consistently  more  dropouts  than  does  DOLPHIN,  but  adso  its  sampling 
rate  is  higher,  as  shown  by  the  x-axis  (sample  number)  in  the  plots  of  Fig. 
11.  After  discarding  dropouts  we  see  that  the  equivalent  sampling  rates  of 
both  systems  become  closer. 


DOLPHIN  raw  data 
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DOLPHIN  data  after  dropout  removal 
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Fig.  11:  Effect  of  dropout  elimination 


We  also  analyzed  the  number  of  dropouts  as  a  function  of  beam  number 
for  both  the  Littlehales  and  the  DOLPHIN  for  a  section  of  line  C.  The  results 
are  shown  in  Fig.  12  for  the  bathymetry  shown  in  Fig.  13.  Almost  all  the 
dropouts  the  Littlehales  suffered  were  going  up  the  steep  slope  shown  in  Fig. 
13.  DOLPHIN  seems  to  handle  slopes  much  better.  Notice  that  the  dropouts 
are  a  much  higher  percentage  of  the  total  samples  for  the  Littlehales  than 
for  the  DOLPHIN,  and  also  that  for  unknown  reasons  the  center  beams  of 
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the  Littlehales  seem  to  dropout  more  frequently  than  those  a  little  ofiF-center; 
this  behavior  is  not  present  on  the  DOLPHIN  data,  where  the  close-to-nadir 
beams  suffer  less  dropouts  than  all  others.  Although  the  plot  of  dropouts  vs. 
beam  number  is  generally  “U”  shaped,  we  can  see  that  it  is  not  symmetric, 
with  the  DOLPHIN  having  more  dropouts  on  its  port  side.  It  is  not  clear 
why  the  Littlehales  didn’t  record  any  depths  for  beams  1  through  3,  31  and 
32.  It  would  seem  that  the  ultrawide  mode  was  used  for  all  depths  iu  the 
range  shown  in  Fig.  13,  which  is  not  expected  (see  Table  1). 


Baam  dropouts  tor  UTTLEHAUES 


Fig.  12:  Dropouts  vs.  beam  number 
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Fig.  13:  Raw  bathymetry  of  parts  of  line  C 
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5.3  Beam  Noise 


Table  4  shows  the  standard  deviation  of  the  noise  in  the  center  beam  (beam 
16)  of  the  EM  100  on  the  DOLPHIN  and  the  Littlehales,  and  in  the  two  center 
beams  (beams  9  and  10)  of  the  HC  II  on  the  Whiting  for  three  main  lines  and 
one  cross  line  in  Site  B.  The  average  depth  of  the  line  is  given  simply  as  a 
reference,  since  the  area  has  steep  slopes.  Table  5  lists  the  same  information 
for  the  two  outermost  beams  (beams  1  and  10)  of  the  EM  100  for  both  the 
Littlehales  and  the  DOLPHIN.  Notice  these  tables  are  for  intermediate  depths 
waters.  Whiting's  outermost  beams  were  not  tabulated  in  Table  5  because 
it  had  a  different  sonar  system  with  outer  beams  that  do  not  cover  the  same 
areas  as  the  EMlOO’s  outer  beams  due  to  the  difference  in  swath  width  and 
beam  width. 


Table  4:  The  rms  noise  in  the  center  beams 


Platform 

Beam 

Line 

Course 

Depth 

a  (m) 

DOLPHIN 

16 

1.5 

Littlehales 

16 

B03 

139" 

450 

1.1 

Whiting 

9 

3.9 

Whiting 

10 

4.1 

DOLPHIN 

16 

1.9 

Littlehales 

16 

B04 

319" 

410 

1.6 

Whiting 

9 

3.2 

Whiting 

10 

3.7 

DOLPHIN 

16 

2.0 

Littlehales 

16 

B07 

139" 

290 

1.3 

Whiting 

9 

2.8 

Whiting 

10 

2.5 

DOLPHIN 

16 

2.1 

Littlehales 

16 

PI, 2 

051/231" 

300 

1.9 

The  noise  values  shown  in  Tables  4  and  5  were  computed  with  the  method 
explained  in  Section  4.3  after  all  dropouts  were  discarded.  The  sampling  rate 
of  the  HC  II  is  much  slower  than  that  of  the  EM  100  so  fewer  samples  are 
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available  to  compute  the  noise  of  the  Whiting/HC  II.  For  example,  we  have 
approximately  900  samples  from  the  DOLPHIN/EMlOO  and  only  about  180 
samples  from  the  Whiting/HC  II  for  line  B03.  From  observation  of  the  cr 
values  in  Table  4,  we  see  that  data  from  the  DOLPHIN/EMlOO  is  consistently 
a  little  noisier  than  that  collected  by  the  Litilehales,  regardless  of  the  direction 
of  travel.  It  is  also  less  noisy  than  the  data  from  the  Whiting.  Notice  that 
in  all  cases  the  standard  deviation  is  very  small,  especially  relative  to  the 
average  depth. 


Table  5:  The  rms  noise  in  the  outermost  beams 


Platform 

Beam 

Line 

Depth 

a  (m) 

DOLPHIN 

1 

B03 

430 

1.0 

DOLPHIN 

32 

B03 

480 

1.6 

Littlehales 

1 

B03 

400 

1.0 

Littlehales 

32 

B03 

480 

0.9 

DOLPHIN 

1 

B04 

440 

2.6 

DOLPHIN 

32 

B04 

380 

2.0 

Littlehales 

1 

B04 

440 

2.1 

Littlehales 

32 

B04 

380 

1.8 

DOLPHIN 

1 

B07 

290 

1.5 

DOLPHIN 

32 

B07 

310 

1.9 

Littlehales 

1 

B07 

280 

1.3 

Littlehales 

32 

B07 

320 

1.6 

DOLPHIN 

1 

PI 

310 

2.4 

DOLPHIN 

32 

PI 

290 

2.5 

Littlehales 

1 

PI 

310 

2.1 

Littlehales 

32 

PI 

290 

2.1 

Opposite  to  what  was  expected  and  obtained  for  other  systems  [10],  the 
noise  in  the  outermost  beams  is  not  consistently  larger  than  the  noise  in 
the  center  beams.  The  outer  beams  of  the  DOLPHIN  are  also  noisier  than 
the  corresponding  beams  of  the  Littlehales,  the  same  as  the  center  beams. 
Although  not  all  beams  were  compared,  we  conclude  that  most  of  the  time 
the  data  collected  by  the  ship  has  a  lower  level  of  noise  than  the  data  collected 
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Depth  (m) 


Raw  Data  with  numerous  dropouts 
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Raw  Data  after  Dropout  Removal  and  Fit 


Fig.  14:  Spurious  noise  in  Littlehales  data 

by  the  ROV,  but  the  difference  is  small  (between  0.0  and  0.7  m  for  the  data 
shown  in  Tables  4  and  5),  and  may  be  negligible  since  the  a  itself  is  very 
small  for  intermediate  depths.  Notice  also  that  the  absolute  noise  (in  meters) 
increases  with  increasing  depth.  Further  noise  analysis  will  be  presented 
shortly  for  shallow  flat  areas,  where  it  is  meaningful  to  give  rms  error  as 
percentage  of  depth. 

In  certain  instances  —  e.g.,  when  the  original  data  has  too  many  con¬ 
secutive  dropouts,  or  when  slopes  are  extremely  steep  —  the  clean  raw  data 
signal  has  discontinuities  or  sudden  changes  in  depth,  which  in  turn  cause 
the  noise  computed  for  those  areas  to  be  larger  than  the  actual  system  noise 
we  are  trying  to  compute.  For  example  see  Fig.  14,  where  data  from  beam 
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number  1  of  the  EMlOO  in  the  Littlehales  are  shown.  Notice  that  there  are 
not  only  numerous  dropouts  ail  along  the  line  reducing  the  amount  of  useful 
data  considerably  but  also  the  difficulty  in  fitting  a  curve  to  the  raw  data 
around  samples  number  90  and  160  of  the  middle  plot.  This  is  reflected  in  the 
bottom  plot,  where  large  values  of  noise  are  obtained  around  those  samples. 
These  large  values  of  noise  do  not  occur  very  frequently,  but  they  very  much 
alter  the  resulting  rms  noise  computation  if  taken  as  being  system  noise.  In 
computing  the  <t  values  given  in  this  report,  we  discard  these  extreme  noise 
values  and  compute  the  rms  noise  from  the  remaining  samples  only  since 
we  know  these  extremes  are  due  to  the  improper  smooth  fit.  The  rms  noise 
values  for  the  data  shown  in  Fig.  14  are  =  3.3  m  when  spurious  noise  is 
considered,  and  <r  =  2. 1  m  otherwise. 

In  analyzing  the  noise  we  noticed  that  the  noise  increased  as  the  depth 
increased;  e.g.,  see  Table  5  and  Fig.  4  .  Further  analysis  showed  that  the 
noise  as  percentage  of  the  depth  stayed  relatively  constant.  In  the  top  plot 
of  Fig.  4  we  show  noisy  center  beam  raw  data  from  a  section  of  line  803 
collected  by  the  DOLPHIN,  together  with  the  smooth  fitted  curve  we  use  in 
computing  the  noise.  The  bottom  plot  of  Fig.  4  shows  the  increaising  noise 
with  increasing  depth.  Splitting  the  data  shown  in  five  equally  long  pieces, 
we  obtain  the  results  shown  in  Table  6.  Notice  that  at  intermediate  depths 
the  noise  is  such  a  small  percentage  of  the  depth  that  it  is  negligible  for  all 
practical  purposes. 


Table  6:  Depth  dependent  rms  noise 


Avg.  depth 

a 

%  Depth 

371 

||1«| 

391 

cm 

mSM 

414 

0.77 

0.2 

425 

0.91 

0.2 

443 

1.13 

0.3 

To  meet  accuracy  standards  of  the  IHO,  the  total  error  in  me^lsuring 
depths  must,  with  a  probability  of  at  least  90%,  not  exceed  1%  of  the  depth, 
and  rms  errors  with  a  normal  distribution  should  not  exceed  0.6%  of  the 
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depth.  The  data  shown  in  this  table  would  clearly  meet  the  required  IHO 
standard  for  rms  errors,  if  this  residual  noise  were  the  only  error  present. 


B«am  Noise  for  ine  HTia 


Fig.  15:  Beam  noise  for  DOLPHIN/EMIOO 

We  also  studied  the  noise  in  each  of  the  32  beams  of  the  DOLPHlN/EMlOO 
system  over  a  flat  area;  the  heave  test  area  was  selected  for  this  purpose.  Un¬ 
fortunately,  the  area  was  so  shallow  —  around  40  m  —  that  the  ultrawide 
mode  was  used  and  we  therefore  don’t  have  data  for  the  outermost  beams. 
The  results  for  the  beams  that  had  depth  registered  are  shown  graphically 
in  Fig.  15,  where  the  same  line  was  run  in  opposite  directions.  The  recorded 
depths  for  beam  number  5  which  shows  a  much  higher  rms  noise  level  than 
ail  other  beams  are  shown  in  the  bottom  plot  of  Fig.  16.  The  top  plot  is  a 
more  typical  and  well  behaved  beam,  beam  number  10,  although  any  other 
could  have  been  chosen.  We  see  that  beam  five  has  many  spurious  depths 
that  go  down  to  about  43  m,  while  most  samples  stay  at  about  38  m.  The 
causes  of  these  “semidropouts”  are  unknown,  and  they  must  be  considered 


when  computing  noise  or  errors.  We  also  expected  the  center  beams  to  be 
less  noisy  than  the  port  or  starboard  beams.  We  don’t  know  why  the  cen¬ 
ter  appears  noisier  in  this  area,  but  further  analysis  showed  that  this  is  not 
usually  the  case,  which  agrees  with  results  from  other  systems  [10]. 


Depths  of  Beam  10  for  Hne  HTta 


Time  (s) 

Fig.  16:  Spurious  noise  in  beam  5  of  DOLPHIN  data 

Figure  17  shows  the  depths  of  beams  16  and  10  of  the  DOLPHIN/EMlOO 
for  line  HTlb,  where  we  see  the  unexpected  behavior  of  the  center  beam, 
beam  16,  being  considerably  noisier  than  an  intermediate  beam,  beam  10. 

We  analyzed  the  frequency  response  of  the  noise  on  center  beam  16  of  the 
DOLPHIN/EMlOO,  and  plotted  it  together  with  the  power  spectral  density 
of  the  heave  registered.  These  power  spectral  densities  obtained  for  lines 
HTlb  are  shown  in  Fig.  18.  The  power  spectrum  estimate  is  performed 
with  FFT  analysis  of  two  sequences  (the  heave  and  the  noise)  using  the 
Welch  method  of  power  spectrum  estimation.  The  sequences  are  divided 
into  a  number  of  sections  and  an  FFT  is  used  on  successive  sections  that  are 
previously  Hanning  windowed  and  then  they  are  accumulated.  As  discussed 
previously,  it  seems  that  the  noise  is  not  due  to  heave,  and  their  spectra  are 
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Depths  oi  beam  16  for  Ine  HTIb 
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Fig.  17;  Beam  noise  for  DOLPHIN/EMlOO  at  about  40-m  depth 

very  different  from  one  another.  Noise  is  relatively  constant  with  frequency 
(flat  or  white),  while  the  power  in  the  heave  signal  decreases  rapidly  with 
increasing  frequency 

The  same  noise  analysis  was  done  on  DOLPHIN  data  for  another  flat 
area,  a  little  deeper  (extra  data  from  turns  after  line  B24).  The  results  are 
shown  in  Fig.  19,  where  we  show  rms  noise  vs.  beam  number,  and  in  Fig.  20, 
where  the  depth  data  and  the  noise  are  shown.  In  Fig.  20  the  top  plot  shows 
the  raw  data  for  the  center  beam  and  the  smooth  fit  to  the  data  that  was 
used  to  compute  the  random  noise  shown  in  the  bottom  plot.  The  depths 
in  this  area  varied  from  99  to  102  m,  which  gives  a  noise  of  around  0.1%  of 
the  depth  for  beams  close  to  nadir  and  less  than  0.25%  for  all  beams.  Notice 
also  that  the  rms  noise  computed  is  not  quantization  error  since  depths  are 
quantized  to  0.075  m  by  the  EMIOO,  which  introduces  a  quantization  error 
of  only  about  5x10"'*  m. 

The  histogram  of  the  noise  in  the  center  beam  is  shown  in  Fig.  21,  and  its 
power  spectrum  in  Fig.  22,  where  the  dashed  lines  show  the  90%  confidence 


Fig.  18:  PSD  of  noise  and  heave  for  DOLPHIN  data 

interval.  We  see  that  the  signal  assumed  to  be  the  noise  in  the  raw  data 
is  quite  flat  and  its  distribution  approaches  a  Gaussian  pdf.  The  noise, 
therefore,  can  be  assumed  to  be  Additive  White  Gaussian  Noise  (AWGN), 
and  ergodicity  may  be  assumed  if  the  topography  is  relatively  smooth. 

Extensive  comparisons  of  system  noise  were  not  performed  between  DOL¬ 
PHIN  and  Whiting  mainly  due  to  the  difference  in  the  sonars  installed,  but 
it  was  frequently  noticed  that  Whiting's  data  appeared  noisier  than  DOL¬ 
PHIN’S.  For  example,  see  Fig.  23,  where  the  depths  registered  at  the  center 
beams  of  both  systems  are  shown. 


31 


Noise  vs.  Beam  Number 


Fig.  19:  Beam  noise  for  DOLPHIN/EMlOO  at  about  100-m  depth 
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Fig.  20:  Noise  in  DOLPHIN  data  for  a  flat  area 
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Fig.  21;  Histogram  of  noise  in  DOLPHIN  data  for  a  Bat  area 


Fig.  22:  PSD  of  noise  in  DOLPHIN  data  for  a  flat  area 
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Center  Beam  of  DOLPHIN 


Fig.  23;  Bathymetry  from  DOLPHIN  and  Whiting 


35 


5.4  Repeatability  Test 

To  determine  the  repeatability  of  DOLPHIN’S  bathymetry  generation,  we 
compared  data  from  line  Cl  that  was  collected  on  two  ujfferent  dates.  This 
line  produced  data  for  a  long  and  narrow  strip.  Due  to  the  difference  in 
dimensions  in  the  lat/lon  plane,  standard  gridding  programs  were  not  used 
to  avoid  excessive  extrapolation.  Instead,  programs  were  written  to  grid  a 
small  square  area  at  a  time.  Statistics  were  then  computed  for  the  small  area. 
Some  results  are  shown  in  Table  7  in  the  next  section  for  the  area  between 
37°  02'  03.00"iV,75°  13'  24.50"W^  and  37°  02'  05.23"iV,75°  13'  2S.9S"W,  with 
depths  between  35  and  40  m.  The  data  were  collected  on  5,  6,  and  7  August 
1992,  and  data  from  5  August  1992  are  taken  as  the  reference. 


DOLPHIN  Bathymetry  05/07  AUG 


Fig.  24:  DOLPHIN  bathymetry  for  a  section  of  line  C 


The  bathymetry  produced  from  two  of  these  data  sets,  namely,  5  and  7 
August  1992,  are  shown  as  surface  plots  in  Fig.  24  top  and  bottom,  respec- 


tively.  They  visually  agree  well,  having  very  close  depths  and  very  similar 
morphology.  Statistics  for  the  difference  for  these  and  other  sets  of  data  are 
given  in  Table  7  in  the  next  section  of  this  report.  There  we  see  that  the 
soundings  have  an  rms  difference  of  between  1  and  1.5%  of  the  depth. 

Figure  25  shows  the  distribution  of  the  differences  in  bathymetry  com¬ 
puted  between  DOLPHIN  data  of  parts  of  line  Cl  from  5  August  1992  and 
6  August  1992  (top  plot),  and  between  5  August  1992  and  7  August  1992 
(bottom  plot).  Both  plots  indicate  a  normal  distribution  of  the  difference  in 
depth,  with  mean  close  to  zero.  The  distribution  of  the  difference  between 
5  August  1992  and  7  August  1992  is  narrower  and  taller,  corroborating  that 
the  results  obtained  for  these  two  days  are  closer  to  one  another  than  for  5 
August  1992  and  6  August  1992,  as  shown  by  the  rms  differences  in  Table  7. 


5.5  Comparison  of  Bathymetry 

The  area  for  the  bathymetry  comparison  shown  in  Figs.  26-29  is  from 
37<’04'15"N  to  37‘’04'30"N  and  from  74‘’38'30"W  to  74°39'00"W.  These  fig¬ 
ures  show  the  gridded  bathymetry  in  the  form  of  surface  plots,  for  each  of  the 
three  platforms,  as  well  as  the  depth  difference  surfaces.  The  same  gridding 
algorithm  was  used  on  the  three  sets  of  data.  Looking  at  the  surface  plots 
it  is  obvious  certain  differences  exist  between  the  bathymetry  generated  by 
the  various  systems,  as  expected.  Also  clear,  though,  is  the  fact  that  the 
topology  generated  by  the  three  is  quite  similar,  with  depths  that  generally 
closely  agree. 

The  corresponding  50-m  contours  are  shown  in  Fig.  30.  The  contours 
generated  did  not  lay  on  top  of  one  another;  even  contours  generated  from 
the  same  system  cannot  be  expected  to  agree  completely  [11].  In  some  cases 
the  contour  line  produced  by  DOLPHIN  is  found  between  those  of  Whiting 
and  Littlehales.  Clear  in  Figs.  26-28  and  30  is  that  the  bathymetry  produced 
from  data  collected  by  DOLPHIN  is  smoother  than  that  of  either  ship. 

The  feature  at  about  37°04'17"N,  74®38'44"VF  in  Fig.  30  seems  to  be  a 
gridding  artifact,  and  it  was  not  produced  by  gridding  DOLPHIN’S  data. 
The  spike  produced  at  the  top  right  corner  of  Littkh^les's  bathymetry  is  also 
a  gridding  artifact.  These  are  usually  smoothed  by  hand  after  postprocessing 
[8].  Fig.  29  shows  the  difference  surface  produced  by  comparing  DOLPHIN’S 
bathymetry  to  Littlehahs’s  (top)  and  to  Whiting  (bottom). 
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PDF  of  deptfi  diffetences  5/6  and  5/7  August 
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Fig.  25;  Histogram  of  depth  differences 
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Bcttiymatry  of «  Mdion  of  SIM  8  (WHITINQ) 


Fig.  28:  Bathymetry  from 
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Fig.  29:  Difference  in  bathymetry 
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Latitude  {s  N  from  37 


SO-m  contour  lines  for  a  sector  of  Site  6 


Fig.  30:  Depth  contours 


Table  7  shows  the  statistics  of  the  difference  between  the  bathymetry 
generated  by  DOLPHIN/EM-100,  WhitinglUC  II,  and  Liff/eAfl/es/EMlOO;  it 
also  shows  comparison  data  for  DOLPHIN/EM-100  on  three  different  dates, 
as  discussed  in  the  previous  section.  The  gridded  points  used  for  computation 
of  statistics  were  obtained  by  interpolation  within  the  two-dimensional  func¬ 
tion  described  by  the  nonuniformly  sp2u:ed  vectors  (Lat, Lon, Depth)  using  an 
inverse  distance  method. 


Table  7:  Bathymetry  comparison 


In  Meters  j 

Percentage  of  depth 

Sy?tem 

mm 

a 

rms 

mm 

a 

rms 

pdf 

DOLPHIN  vs.  Littkh. 

-1.73 

6.33 

6.56 

0.58 

1.90 

1.99 

normal 

DOLPHIN  vs.  Whiting 

-1.25 

6.21 

6.35 

0.28 

1.88 

1.90 

normal 

Littkh  vs.  Whiting 

0.48 

6.97 

6.99 

-0.32 

2.23 

2.25 

normal 

DOLPHIN  Cl(05/06) 

Q|9 

isa 

-0.45 

Ull 

normal 

DOLPHIN  Cl(05/07) 

Ha 

mi 

iSI 

-0.35 

EEl 

normal 

DOLPHIN  Cl(06/07) 

-0.03 

0.42 

0.42 

0.08 

1.21 

normal 

In  Table  7  ^  is  the  mean  difference  between  the  pair  of  systems  compared, 
a  is  the  standard  deviation,  and  rms  is  the  root  mean  square  value,  as  given 
in  (2),  (3),  and  (4),  respectively.  The  rms  and  er  differ  very  little  due  to 
the  small  value  of  the  difference  p.  On  the  average,  the  gridded  depths  from 
DOLPHIN  differ  from  those  of  Whiting  by  less  than  from  those  of  Littlehales, 
which  could  be  partly  attributed  to  the  different  survey  dates.  Nonetheless, 
for  this  particular  area,  the  bathymetry  produced  by  Whiting  is  closer  in 
the  mean  to  that  of  Littkhaks  than  to  that  of  the  ROV.  The  DOLPHIN 
sounded  shallower  than  the  others  (negative  /i  means  the  second  system 
listed  in  the  first  column  sounds  deeper)  in  this  area.  More  meaningful  than 
mean  difference  are  the  columns  a  and  rms.  Clearly  the  largest  variation 
was  between  the  bathymetry  of  the  Littkhaks  and  the  Whiting.,  with  the 
difference  between  DOLPHIN  and  its  mother  ship  being  the  smallest. 

If  any  one  of  the  three  sets  of  depths  is  taken  as  the  “true”  depth,  neither 
of  the  other  two  systems  meets  IHO  standards  since  the  rms  errors  do  exceed 
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0.6%  of  the  depth;  they  are  all  close  to  2%.  There  seems  to  be  a  consensus 
[11]  that  is  shared  by  the  authors,  that  to  expect  accuracies  better  than 
0.6%  is  fictitious.  There  are  too  many  factors  that  introduce  errors  in  the 
final  bathymetry,  a  few  are  lack  of  exact  velocity  profiles,  which  produces 
uncertainty  in  ray  bending  computation,  and  difficulty  in  correcting  for  the 
vessel’s  movements  [12].  Regardless  of  the  “acceptable”  percentage  error,  it 
would  seem  that  bathymetry  produced  by  data  collected  by  the  DOLPHIN  is 
better  than  that  of  the  ships.  By  this  we  mean  that  if  the  bathymetry  from 
either  of  the  other  two  platforms  is  taken  as  the  “truth,”  the  DOLPHIN  is 
closer  to  it  (as  indicated  by  the  rms  error)  than  the  other  ship  is.  More 
comparisons  are  necessary  to  arrive  at  a  definite  conclusion. 

6.0  Conclusions 

We  have  presented  an  evaluation  of  the  performance  of  the  DOLPHIN  ROV 
as  a  platform  for  collection  of  multibeam  sonar  data.  Results  were  presented 
about  the  stability  of  the  platform,  the  noise  of  the  system,  and  the  quality 
of  the  raw  data  and  also  of  the  resulting  bathymetry.  Comparisons  were 
made  to  results  obtained  from  data  collected  during  the  same  survey  by  the 
dolphin’s  mother  ship,  the  Whiting,  and  from  data  collected  at  a  later 
date  by  the  Littlehales. 

Our  results  indicate  that  the  DOLPHIN  does  not  consistently  pitch  less 
than  the  ship,  and  that  the  movement  is  highly  dependent  on  the  direction  of 
travel.  Also,  data  from  the  ships  show  spurts  of  high  amplitude  pitch  that  are 
not  present  in  the  ROV’s  data.  The  DOLPHIN  pitched  at  a  lower  frequency 
than  its  mother  ship,  and  in  a  more  random-like  fashion.  We  didn’t  find  any 
evidence  of  heave  being  responsible  for  the  system’s  noise,  i.e.,  there  was  no 
strong  correlation  between  the  two. 

All  the  data  analyzed  indicated  that  the  Littlehales /EMIOO  system  suf¬ 
fered  from  a  very  large  number  of  dropouts,  so  that  the  percentage  of  invalid 
data  is  much  larger  for  the  ship  than  for  the  DOLPHlN/EMlOO.  The  sam¬ 
pling  rates  for  these  two  systems  were  not  identical  so  the  ADR  was  used 
to  compare  the  dropouts  relative  to  sampling  frequency.  DOLPHIN  had  a 
smaller  ADR.  Both  systems  usually  have  more  dropouts  in  the  outer  beams. 

Noise  analysis  showed  that  the  Littlehales /EMIOO  system  has  a  lower 
noise  level  than  the  DOLPHIN/EMlOO,  but  in  both  cases  the  noise  is  neg¬ 
ligible.  Whiting's  data  are  noisier,  but  it  also  had  a  different  sonar  system. 
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The  absolute  noise  level  increases  with  increasing  depth,  but  remains  rela¬ 
tively  constant  as  percentage  of  depth.  Both  EM  100  systems  suffered  from 
spurious  unexplained  beam  noise  and  did  not  consistently  obey  the  trend  of 
decreasing  noise  for  beams  approaiching  nadir,  although  this  was  most  fre¬ 
quently  the  ciuie.  The  power  spectrum  of  the  noise  is  Oat,  and  the  distribution 
of  the  noise  is  Gaussian. 

Results  from  the  repeatability  test  indicate  that  the  DOLPHIN/EM  100 
platform  collects  consistent  data;  i.e.,  bathymetry  produced  by  data  sets 
collected  in  different  condition  closely  agree.  Results  generated  from  data 
collected  by  the  different  platforms  do  not  agree  as  closely,  with  rms  difference 
of  about  2%  of  the  depth.  The  bathymetry  between  the  DOLPHIN  and 
Whiting  differs  less  than  than  between  any  other  pair  of  platforms. 

The  authors  conclude  that  the  DOLPHIN  ROV  is  an  excellent  platform 
for  collecting  multibeam  bathymetric  data,  and  possibly  other  kinds  of  sonar 
data  as  well.  The  platform  is  stable,  it  introduces  negligible  noise  to  the 
system,  suffers  from  very  few  dropouts,  and  produces  bathymetry  of  quality 
comparable  to  that  produced  by  data  collected  by  a  ship. 

7.0  Suggestions  for  Further  Work 

The  standard  processing  applied  to  HC  II  data  merges  navigation  and  raw 
bathymetry  onto  a  “merged”  file;  this  file  does  not  contain  information  on  roll 
and  heave,  and  records  depths  quantized  to  1  m.  To  the  best  of  the  authors’ 
knowledge  the  only  other  data  that  the  premerged  raw  data  files  contain 
and  that  can  be  used  directly  is  heave.  Further  analysis  of  platform  attitude 
movements  must  compare  roll  and  heave  between  DOLPHIN  and  Whiting. 
Unfortunately  the  actual  roll  of  the  Whiting  is  not  directly  available^.  Only 
after  these  comparisons  are  made  can  a  definite  conclusion  be  made  about 
the  relative  stability  of  the  platforms. 

Data  from  several  patch  tests  performed  by  the  DOLPHIN  are  available 
and  can  be  analyzed  using  the  techniques  presented  in  [13,  14]  to  determine 
pitch,  gyro,  time  delay,  and  roll  biases.  Also  available  are  data  from  overlap¬ 
ping  beams  that  can  be  used  to  evaluate  the  errors  of  the  outer  beams,  as 
compared  to  the  inner  beams.  This  analysis  will  complement  the  beam  noise 
analysis  presented  in  this  report. 

^Only  roll  at  receive  beam  number  5  is  recorded  on  the  .HC2  files. 
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Many  more  comparisons  can  be  made  between  bathymetry  generated  by 
the  three  systems.  This  is  not  straightforward,  though,  since  interpolation 
(gridding)  without  extrapolations  needs  to  be  done  on  the  data,  trying  to 
keep  other  factors  constant,  such  as  the  number  of  original  points  per  grid 
point.  Contoured  data  might  be  a  simpler  way  to  compare  bathymetry.  The 
problem  still  remains  of  not  having  a  “true  depth"  to  base  the  comparison 
upon.  Revision  of  IHO  standards  might  need  to  be  performed.  It  seems  very 
hard  to  achieve  rms  errors  not  larger  than  0.6%  of  the  depth,  with  a  90% 
confidence  that  the  total  error  won’t  exceed  1%  of  the  depth. 

Line  BOS  was  surveyed  twice,  the  second  time  with  a  rougher  sea  state. 
The  intent  was  to  analyze  the  effect  of  sea  state  on  the  collected  data,  the 
results  are  not  included  in  this  report.  Also,  the  line  was  unfortunately 
surveyed  in  opposite  directions. 

It  would  be  interesting  to  evaluate  the  performance  of  the  DOLPHIN  as 
a  collection  of  sonar  data  to  produce  imagery.  Some  discussion  of  a  possible 
configuration  with  an  EM  1000  is  given  in  (4). 
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